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. Abstract 

Q ' In this paper we study some properties of random walks perturbed at extrema, which 

are generalizations of the walks considered e.g. in Davis (1999). This process can also be 
viewed as a version of excited random walk, studied recently by many authors. We obtain 

Ph 

a few properties related to the range of the process with infinite memory. We also prove 

(-h \ the strong law, CLT, and the criterion for the recurrence of the perturbed walk with finite 

-i— > . 

, memory. 
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g : 1 Introduction 

This paper has been inspired by the results of Davis (1999) for the random walks perturbed 
at extrema. Davis (1999) studied the stochastic process which is the limit one of the walks 
described below. Our purpose here is to study the properties of these perturbed walks as they 
are, without considering the limit process found in Davis (1999). Let < p < 1 and < q < 1. 
Fix a number L which is either a positive integer or +oo. We define a perturbed at L-extrema 
random walk X k as a nearest-neighbour random walk on Z 1 with the transitional probabilities 
F(X k+1 = x + l\X k = x) = l- P(X fc+1 = x — l\X k = x) equal to 

p, if x = max m=0jli LAfe X k _ m ; 

q, if x = miHm=o,i,...,£Afc X k - m \ 
2, otherwise. 

For definiteness, if x is both the maximum and the minimum, we let this probability be | (this 
obviously happens only when k — 0). 
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When L is finite, we will call this walk a walk with finite memory. In this case, it is natural 
to think of this process as of a "snake" (hence the title of the paper, compare our process with a 
famous video game, released during the mid 1970s, see Surhone, Tennoe, and Henssonow (2010) ) 
of length L units moving on the integers, whose transition probabilities depend on whether the 
snake is surrounded by parts of its body or not. 

The case L = oo corresponds to the walk perturbed at global extrema, and we will refer to 
this walk as the walk with infinite memory. It was shown in Davis (1999) that this walk, properly 
rescaled, converges to a certain stochastic process. Other relevant papers are Davis (1990, 1996); 
Benjamini and Wilson (2003) and Volkov (2003) studied an excited random walk (ERW), which 
transitional probabilities differ when the walk visits a site for the first time. Zerner (2005) studied 
multi-excited random walks on integers. More recently, Basdevant and Singh (2008a) got some 
interesting results on the speed of ERW, confirming certain conjectures posed in Zerner (2005), 
and computed the exact rate of growth in the zero-speed regime in (2008b), while Kosygina and 
Zerner (2008) obtained annealed CLT for ERW, using branching theory techniques. 

When L = oo, our process can be viewed as a special ERW as follows. Consider a site x 
on a positive axis, and place a geometric number M x of cookies at the site, such that ¥(M X = 
k) = p(l - p) fe -\ k = 1,2,..., and M X) x = 1,2,..., are i.i.d. random variables. Whenever 
the walk visits site x and there are at least two cookie there, it eats one cookie and goes to 
the left. When it eats the last cookie, it goes to the right. Finally, when there are no cookies 
left at a site, the walk goes left or right with equal probabilities. On the negative axis, the 
process is defined similarly with the number of the cookies there distributed according to the law 
F(M X = k) = (1 — q)q k ~ 1 , x = —1, —2, .... There are no cookies at site 0. 

Note that in Kosygina and Zerner (2008) the number of cookies is uniformly bounded, which 
is not the case in our model; also our model resembles drilling random walk introduced in Volkov 
(2003). 

In Section [21 for L = oo we focus on the behaviour of the process in finite time, as opposed to 
Davis (1999). In particular, we obtain some results on the time it takes before the length of the 
visited ( "cookie- free" ) area reaches a certain value. We also compute the limiting probability to 
be at the global maxima, given that the walk is at one of its extrema. 

In Section [3], for L < oo, the process does not resemble ERW mentioned above, and can be 
viewed as a Markov chain on a product space of {— 1,+1} L x Z. We establish that the finite 
memory walk is recurrent if and only if p + q — 1 (compare this with the case L = oo when the 
walk is always recurrent). Also we obtain strong law and CLT for our process, and show how 
the speed of the transient process, when p + q ^ 1, decays as L grows. 

We conclude with conjecture and open problems in Section HI 
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Before we proceed with the next section, let us introduce a few notations. Let 

M = M{k) = M L (k) = max X k+ i_ u 

i=l,2,...,LAk 

m = m(k) = xu,L(k) = min X k+ i^. 

i=l,2,...,LAk 

If X k ^ m and Xj. ^ Ai then our process behaves exactly as a simple random walk (SRW). 
The only differences between X k and the SRW occur when either X k = m or X k = A4. Let 
TZ(k) = M.(k) — m(k) be the range (the spread) of the walk and p n = min{/c : TZ(k) = n} be 
the stopping time when this range reaches n. At some point we will interested in the quantity 

An,n+1 = Pn+l ~ Pn- 

These notations A4, m, p n , and A nn+1 will be used throughout the paper. 



2 Properties of the perturbed random walks with infinite 
memory: L = +00 

In this section we establish some interesting properties of the perturbed random walks with 
infinite memory. 

To characterize its distribution, without loss of generality suppose that m(k) = 0, M.{k) = n, 
and let $ n) = inf{t : X t = -1 or n + 1 1 Xq = 1} be the random time until the range is increased 
given that the walk starts at I, < I < n. Since 0; = 0^(A) = E exp(— A£^ ), the Laplace 
transform of satisfies 

0o = e" A [g0 1 + (l-g)-l], / = 0; 

0, = e" A [O.50 z _i + O.50 m ], < I < n- 

0n = e^ A [p-l + (l-p)0 n _i], l = n, (2.1) 
it can be represented for A > as 

<Pi = dC l + C 2 C\ where C = e A + \/e 2A - 1. 
The coefficients Ci,C 2 should be chosen to satisfy (12.11) . Solving for them, we obtain that 

_ a - ?)e A c 2 (i - c 2 ") - (i - P )(i - ?)c 3 (i - n+wc +1 (i - c 2 ) 

<P° e 2A C 2 (1 _ C 2n) _ (1 + q _ p)e A C 3 (l _ £2.-2) + ?(1 _ p ) C 4 (1 _ 

and 

K 2 e A (1 _ C 2n } _ pgC 3 (1 _ + (1 _ _ _ Q 

e 2A^2( 1 _ £2n) _ (! + g _ p) e A^3(! _ £2n-2) + _ p )£4(! _ £2n-4) 
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Let D M = D M {n) = E (A„ >n+1 1 X Pn = M{p n )) and D m = D m (n) = E (A n , n+1 | X Pn = m(p„)). 
Then 

(1 — p — q + pq)n 2 + {p + 2q — 3pq)n + 1 — p — q + 2pq 



D 



M 



dX 



A=0 



A=0 



1 — q — p + 2pq + p(l — q)n 
pqn 2 + (p + 2q — 3pq)n + 1 — p — q + 2pq 
1 — q — p + 2pg + p(l — q)n 



Note that for large n we have 



D M (n) = l —^n + 0(1), D m (n) = -^—n + 0(1). 



(2.2) 



p 1 — q 

Next, let p» = p M (n) = W(X Pn+1 = M(p n+1 ) | X Pn = M(p n )) and p m = p m (n) = P(X Pn+1 = 
m(p n+ i) | X Pn = m(p n )) be the probabilities that once the range has increased at the maximum 
(resp. minimum) the next increase will take place again at the maximum (resp. minimum). 
Then these probabilities satisfy 

( n — \ 1 

PM = V + (1 -P) Pm + -(1 - Pm) 

\ n n 

fn-1 l n 

Pm = 1 - q + q\ Pm + -(i - Pm, 

\ n n 



The solution to this system is 

Pm =PM{n) 
Pm = Pm(n) 



p(l — q)n + pq 



1 — p — q + 2pq +p(l — q)n 
p{l — q)n + pq — p — q+1 



1 — p — q + 2pq + p(l — q)n 
For large n both probabilities are close to one: 



(2.3) 



PM{n) 



1-p 1 



x - + 0(n 2 ), p m (n) 



q 



x - + 0(n 



p n 1 — q n 

Now consider the induced chain Y n with Y n — 1 if X Pn = A4(p n ), and Y n = if X Pn = m(p n ). 
It is straightforward that is a time-nonhomogeneous Markov chain. We state, however, that 
it still has a limiting distribution: 



Proposition 1 



lim F(Y n = 1) 



pq 



1 — p — q + 2pg 

Proof: The matrix of transitional probabilities for the chain {Y n } with the states {1, 0} is 



A 



p M (n) l-p M (n) 



1 — a/n a/n 
b/n 1 — b/n 



0(n 



where a — (1 — p)/p, b — q/(l — q), using the formulas for p^(n) and p m (n) given by (12. 3p . 
Observe that 



A n = BC n B + 0(n 



where 



B 



and 



C 



1 -a/b 
1 1 



1 

1 - (a + b)/n 



Hence, for m > n, 



A n A n+l A n+2 ...A m = B \ I jjm ^_a±b, }B- 1 + 0(n' 1 -m- 1 ' 



b + a(n/m) a+b a — a(n/m) a+b 

1 + 0((m - n)n" 2 ) 



(2.4) 



'» b-b(n/m) a+b a + b(n/m) a+b 
In particular, if 7r n = P(F n = 1) = 6/ (a + 6) + 5 n = tim + $ni then 

7r n+ i = P(F n+ i = 1) = ir n p M (n) + (1 - 7T n )(l -p m (n)) = ir M + 

where 

<W = (l-^ + 0(n- 2 )^„. (2.5) 

Since the sequence <5 n 's satisfies (12. 5p and a + 6 > 0, it is easy to see that lim^oo^ = and 
therefore lim^ooVTn = tim- (In fact, we can even conclude that n n = tim + 0(1) /n a+b ). ■ 

Theorem 1 (a) For large n 

EA n ,„ +1 = — ^ ^— + o(n). 

1 — p — q + *pq 

(b) Asymptotically, 

9(1 ~ P ' xf + o(n 3). 
1 — p — g + 2pg 2 
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Proof: We start with part (a). Observe that 



n 

E(A n>n+1 \X Pn = m(p n )) 



n 



F{Y n = 0) 



= 7T« H (1-TTnj ► + q (1 ~ ^Mj 

n n p 1 — g 

by Proposition [T]and formula ( 12. 2p . Now part (b) of the corollary immediately follows from part 
(a) and the fact that p n = Y17=o ■ 



3 Finite memory: < L < oo 

Note that if we include the history of the process Xk for the past L steps, it becomes a Markov 
chain. Formally, let Yk = (r)l, r)l, ... , rj k ) be the sequence of — l'a or +l's of length L, with rf k := 
Xk-i+i — X^-i, i = 1, 2, . . . , L. From Y k s it is possible to extract the information whether the 
process X k hit its local maximum or minimum, as described below. Therefore, the pair (X^, Yk) 
is a Markov chain; moreover Y^'s itself form a Markov chain on the space <B^ = { — 1, +1} L of 
the sequences of plus and minus ones of length L. 

lfY k = r] = (77 1 , rf, . . . , rj L ), then let S(r),j) denote 77 1 + rf + ■ — \-rf , j = 1,2, ... ,L. We say 
that 77 is a local maximum, if S(rj,j) > for j = 1,2, ... ,L; local minimum if S(j],j) < for 
j = 1,2, ... , L; and "neither" otherwise. Then Xk is a local maximum (minimum resp.) if and 
only if Yk is a local maximum (minimum resp.) 

Note that from each of the 2 L states of (S^ Yk = (77 1 , rf, . . . , 77 L ) can go only to two states: 
Y k+ i = (77*, 77 1 , 77 2 , . . . ,?7 L_1 ), where 77* = +1 or —1. Observe also that 

{p if Y is a local maximum; 
g if Y is a local minimum; 
I otherwise. 

Since the space (B^ is finite, and is obviously irreducible, there exists the limiting occu- 
pational measure for Y& denoted as tt = {^^ L \v)}r]£^ L h which obviously depends on p, q, and 
L. 

Let 

7r(max) = 71(77) 
t; is local max. 

and 

7r(min) = 71(77) 
7? is local min. 
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Observe that < 7r(min) < 1 and < 7r(max) < 1, and set A = A^ := (2p — l)7r(max) + (2q — 
l)7r(min). 

Lemma 1 

lim — - = Al a.s. 

n— >oo Tl 

and hence if A^ ^ then X n is transient. 

Proof of the Lemma Let / : <BS L ^ — > { — 1, +1} be such that f(rj) = r) 1 , i.e. the first coordinate of 
r\. By the strong law for the Markov chains (see e.g. [I], p. 145) 

1 n 

lim - J2f(Y m ) = E n f(Y 1 ) 

m=l 

Since by the construction Y k 's we have Y^m=\ /(^™) = ^m=i(-^m — -^m-i) — — -^o> h suffices 
to show IE n f(Yi) = A. 
Indeed, 

E 7r /(y 1 ) = E^Y] 1 = 7r(max )E ff (F 1 1 1 F is loc .max. 

+ 7r(min)E 7r (Y 1 1 | Yq is loc.min.) 

+ (1 — 7r(max) — 7r(max))E 7r (y i 1 | Yq is neither) 

= 7r(max)(2p — 1) + 7r(min)(2g — 1) 

+ (1 — 7r(max) — 7r(max)) x = A. 

The last statement of the Lemma is straightforward. ■ 
Lemma 2 A < 0, = 0, or > ifp + q — 1 < 0, = 0, or > respectively. 

Proof: Case 1: p + q — 1. In this case, the chain Y n is symmetric. Indeed, if we replace each +1 
by —1 and vice versa, it will have the same distribution since q — 1 — p. Thus by symmetry 
7r(max) = 7r(min). whence A = (2p — l)7r(max) + (2q — l)7r(min) = {(2p — 1) + (2q — l))7r(max) = 
2{jp + q — l)7r(max) = 0. 

Case 2a: p + q > 1, p, q > \ . In this case, 2p — 1 > and 2q — 1 > or 2p — 1 > and 
2q - 1 > 0. Hence, A = (2p - l)vr(max) + (2q - l)7r(min) > 

Case 2b: p + q>l,p>\>q. Construct a new symmetric chain {Y n } with p = p and q = 
1 — p < q < \. Denote 7r and 7r the stationary distributions for Y n and Y n respectively. Using 
a sequence of i.i.d. Uniform[0, 1] random variables U\, U2, ... we will use couple Y n and Y n to 
demonstrate that 7r(max) > 7r(max) and 7r(min) < 7r(min). Then the comparison with case 1 
will imply A > 0. 
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We say that Y n goes right {left resp.), if in the notations of this section 77* = +1 (—1 resp.). 
The analogous terminology is used for Y n . 

The rules of the coupling are quite standard and are as follows. If given Y n -\ = 77 the 
probability to go right is x, where x = p, q, or | resp. (77 is local maximum, or minimum, or 
neither resp.), then Y n goes right if U n < x and goes left otherwise. Similarly, Y n goes to the 
right from the state fj if and only if U n < x where x = |, q or p depending on the state 77. 

For 77,77 e £ (L) we write 77 y fj whenever 77* > (77)* for all % = 1, 2, . . . , L. Start with Yq = Yq. 
Then it is easy to see by induction that Y n y Y n for all n. Indeed, Y y Yq. Next, if Y m y Y m 
then 

(a) if Y m is a local minimum then Y m is also a local minimum and hence 77 < 77 with the strict 
inequality whenever q < U m < q; 

(b) if Y m is a local maximum then fj < 77 since p > max(/5, |, q) 

(c) if Y m is neither of the above then Y n cannot be local maximum, and again fj < rj since 
\ > max(|, q). 

In all three cases above we have Y m+1 y Y m+1 . 

Finally, u Y n is a local minimum" implies u Y n is a local minimum" and also u Y n is a local 
maximum" implies u Y n is in a local maximum", whence 7r(max) > 7r(max) and 7r(min) < 7r(min). 
Moreover, the event {q < U n < q} has a positive probability, consequently a positive fraction of 
times Y n will achieve new local minimum right after it is a local minimum, while Y n will go the 
right. Hence, 7r(min) > 7r(min). 

Case 2c: p + q > 1, p < | < q. Here we will have to construct a series of couplings, as the 
argument of Case 2b unfortunately cannot be applied directly. 

We will also work directly with X n rather than with Y n ; clearly, 7r(max) and 7r(min) are the 
values determined also by the process X n . 

First, we construct the second process {X n } similar to X n with q = q but with p = 1 — q < p. 
Observe that the process X n is symmetric and define the corresponding Markov chain Y n for 
X n in the same way Y n was defined. Start with Xo = = Xq. Draw a Uniform(0, 1) random 
variable and go to the right if this variable s less than 1/2 and left otherwise. At the fc-th stage, 
draw an independent Uniform(0, 1) random variable, and move to the right for the asymmetric 
chain, {X n ,Y n } 

if Uk < p whenever Xk-i is local max; 
if Uf. < q whenever Xk-i is local min; 
if Uk < \ whenever Xk-\ is neither. 
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Similarly, move to the right for the symmetric chain, {X n ,Y n }, 

if C/fc < p whenever Xk-i is local max; 

if Uk < q — q whenever X^-i is local min; 
if Uk < \ whenever Xk-i is neither. 

Observe that both processes follow the same path till they hit a local maximum, say, at the 
(k — l)-st step. Then the symmetric process has the smaller probability p to move to the right 
(i.e., another local maxima) than the original asymmetric process. In fact, if they make different 
moves, then the asymmetric process satisfies Xk = Xk + 2. 

Our second step is to show by induction that Xk > Xk, in fact, for all k. Assume that 
Xk < Xk, for all k < m, and if for some k, Xk < Xk, then Xk + 2 < Xk- We now show that 
asymmetric process goes ahead of the symmetric process. 

In the table below we write all the possibilities for the two processes at the m-th step, and 
then in each cell we write the pair of probabilities to move to the right. The first number in the 
brackets is the probability for X n and the second number is the one for the symmetric process 





local max. 


neither 


local min. 


local max. 


(p,p) 


(P. J) 


(p,q) 


neither 


(hP) 


( l l ) 




local min. 


(q,P) 


(5,i) 


(q,q) 



In all the cells of lower triangular positions including diagonals (i.e., cells with coordinates 
(1,1), (2, 1), (2, 2), (3, 1), (3, 2), (3, 3) ) the probability of moving to the right for the X n is bigger 
than or equal to the probability of moving to the right for the X n , hence X m+ i > X m+1 for these 
cells. 

Now for cells (1,2) or (1,3), if X m is at the local maximum and X m = X m , then X m must 
also be at the local maximum (since Xk < Xk, Vfc < m by the assumption of induction), which 
contradicts the fact that X m is not at local maximum. Therefore, X m + 2 < X m . Hence at the 
(m + l)-st step if the processes do move not in the same direction, then they would be at most 
equal, i.e., X m+1 < X m+1 . 

Finally, for cell (2, 3), if X m is at local minimum and X m = X m , then X m must also be at the 
local minimum (since Xk > Xk, VA; < m), which contradicts the fact that X m is at neither local 
max nor local min. Thus again X m + 2 < X m and if they make opposite moves at the (m + l)-st 
step they would be at most equal: X m+ i < X m+1 as before. 

Hence we conclude the proof by induction that Xk > Xk for all k and some times Xk + 2 < Xk. 
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The third step consists in using regeneration arguments. Let T\ be the first time k when 
Y k = Y k = (+1, +1, . . . , +1), which is obviously finite as it is stochastically bounded by a 
geometric random variable with parameter max(p, q,p, q, 0.5). At time T\ construct a copy xjp 



of the process X 



(o) ._ 



Xfc, such that Y-jp = Y Tl . By the arguments of the second step, X k > X 



(i) 



for all k > r±. Now let 



r 2 = min{£; > n : Y k = K 



(i) 



-1,+1, 



1)} 



~ (2) ~ 

which is finite by the argument above, and construct another copy X k of the process X k , now 
such that YtP = Y T2 . Repeating this procedure indefinitely we construct the sequence of stopping 



Moreover, r n+ i — r n ,n> 1 



times 7~i, T2, r 3 , . . . and the sequence of processes X k , X k , X k , . 
are i.i.d. with finite expectation, say f. Also, X k > -X^ for all > r„, and because of the 
arguments of step two, X^~ 1 ^ — X^ > 2 with a positive probability; moreover, these increments 



are nonnegative and independent for different n. 
Observing that 



y \x^ - x^ 

m=l 

and using the strong law we obtain 



X Tn - X Tn 



— -> r 

n 



X*r„ — X. 



n 



for some constant a. This, in turn, implies that 



a.s. 



— > a > a.s. 



x k — x k 

k 



-> a/r > 



after applying the renewal law of large numbers (Theorem 1.7.3 from [8]) for the sequence {r k }. 

Finally, in our fourth step, we use Lemma [1] and our result for the symmetric Case 1 applicable 
to X k , to conclude that A > A = 0. Note that this step is only required for the proof of Lemma[2] 
and is not needed for the following Theorem 121 as the transience of X n follows immediately from 
step 3 above (and, of course, Case 1). 

Case 3a: p + q < 1, p, q < ^ . In this case, 2p — 1 < and 2q — 1 < and at least one of the 
inequalities is strict. Consequently, A = (2p — l)7r(max) + (2q — l)7r(min) < 0. 

Case 3b: p + q<l,p<\<q- The proof is exactly similar to that of Case 2c with role of p 
replaced by 1 — q and q by 1 — p, yielding A = [2p — l)7r(max) + [2q — l)7r(min) < 0. 
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Case 3c: p + q < 1, p > | > q. In this case, the proof is exactly similar to that of Case 2b 
with role of p replaced by 1 — q and q by 1 — p, whence A = (2p — l)7r(max) + (2q — l)7r(min) < 0. 
■ 

We now give the criteria for recurrence / transience of the finite memory chain. 

Theorem 2 For any L > 1, the finite memory chain is recurrent if and only if p + q = 1. 

We must note that even when the chain is recurrent but p ^ 1/2, the behaviour of the walk is 
different from that of a simple random walk. In particular, the variability increases for higher 
values of p{= 1 — q). See Figured! 




Figure 1: Trajectories of recurrent walks: red: p = 1 — q = 0.9, black: p = q = 1/2, blue: 
p = 1 — q = 0.1. 

Proof of Theorem [21 If p + q ^ 1 then by Lemma [2] A ^ and hence by Lemma [T] \X n \ — > oo a.s. 

If p + q = 1 then the chain (X n , Y n ) is symmetric with respect to the change —1 -H- +1. Let 
T +oc = {X n — > +00} and T_oo = {X n — > —00}. By symmetry, P(T +oc ) = P(T_oo). On the other 
hand, {X n — > +00} is a tail event, since, for example, there are infinitely many regeneration 
times when Xi = Xi_i + 1 for % — n, n — 1, n — 2, . . . , n — L+ 1. Therefore, by Kolmogorov's zero- 
one law P(T +oc ) G {0, 1}. Hence P(T +DO ) = P(T„oo) = and P(|X n ,| -fr 00) = 1. Consequently, 
there is an k e Z such that X n = k for infinitely many n. And every time the walk hits k, the 
probability it will reach in A; steps is at least [min(p, 1 — p, q, 1 — q, |)]' fc ' > 0. This implies the 
recurrence of X„ . ■ 



Theorem 3 For any L > 1, the finite memory chain satisfies the central limit theorem, that is 

Af(0,a< 



X n -nA L 2 



n 

m+l 



where a 2 = Var„{f{Y 1 )) + 2]xm {m ^ oo} £™+ l Ccw n (f(Y 1 ), f(Y k+1 )). 
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Proof: For / defined as in Lemma [TJ use Functional CLT on positive recurrent Markov chains 
{Y} (see, Theorem 10.2, p.150 of g]) to get 

where a 2 = Var^{f{Yi)) + 21im{ m ^ 00 } X)fc=L Cov^fiYi), f(Y k+ i)) whenever the limit exists and 
is finite, which holds for a finite state-space Markov Chain {Y}. ■ 



4 Conjectures and open problems 

Here we list a few open problems and conjectures at which we have arrived by mostly looking at 
simulations of the process. 

0.09 
O.OS 
0.07 
0.06 
0.05 
0.04 
0.03 
0.02 

lOO 200 300 400 SOO 

Z. 

p— 0.6 q— 0.6 

Figure 2: The speed A L as a function of L vs. const ■ (2LloglogL)~ 1//2 . 

In the transient case, when p + q ^ 1, the numerical simulations suggest that for fixed p and 
q we have 

A 1 
L ^ ^loglogL 

(see Figure [2]). We believe that this order of magnitude corresponds to the fact that the range 
of the walk within the last L steps is of order \/L and hence the frequency at which it visits 
the local maxima and minima, where it gets "a push" is something like L~ l l 2 but unfortunately 
we do not have proof of this fact. The intuition behind this is that for a simple random walk 
(p = q = 1/2) the probability to be at the maxima is asymptotically 1/y/irL; this follows from 
Theorem l.a in Chapter XII. 8 and Theorem 1 in Chapter XVIII. 5 in [9]. 

Also, we conjecture that depends not only on "drift" p + q — 1, but in a complicated way 
on both p and q, see Figure [3] where in both cases the walk is transient. 
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Figure 3: Left: p = 0.95, q = 0.15. Right: q = 0.95, p = 0.15. 

Recall that in general we have = (2p — l)7r(max) + (2q — l)7r(min), so estimating 7r(max) 
and 7r(min) is crucial in order to get the speed of the walk. We have another conjecture justified 
numerically: if q = 1/2 (so the walk is not perturbed at the minima) then 

1 r 1/2 

1 + a L (l -p) 

Again, we do not have a rigorous argument for this, and it would be hence nice to obtain a 
rigorous proof of this asymptotic dependence. 
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